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FOU RI ER-MOTZKIN  ELIMINATION  AND  ITS  DUAL 


by 

George  B.  Dantzig 

Research  on  linear  inequalities  systems  prior  to  1947  consisted 

of  isolated  efforts  by  a  few  investigators.  A  case  in  point  is  the 

elimination  technique  for  reducing  the  no  •'ber  of  variables  in  the 

system.  A  description  of  the  method  can  be  found  in  Motzkin's  1936 

Ph.D.  thesis."^  It  differs  from  its  analog  for  systems  of  equations  in 

that  (unfortunately)  each  step  in  the  elimination  can  greatly  increase 

the  number  of  inequalities  in  the  remaining  variables.  For  years  the 

method  was  referred  to  as  the  Motzkin  Elimination  Method.  However, 

because  of  the  odd  grave-digging  custom  of  looking  for  artifacts  in  long 

forgotten  papers,  it  is  now  known  as  the  Fourier-Motzkin  Elimination 
2 

Method. 

Given  a  system  of  linear  inequalities:  Find  x  =  (x^,  ...  ,  x^) 
such  that 

n 

(1)  ^  a.,  x.  >  b  ,  i  =  (1,  ...  ,  m) 

jZi  ij  j  ~  i  ’ 

One  may  partition  it  into  three  sets  of  inequalities  according  to  whether 
the  coefficients  of  x^  are  positive,  negative  or  zero.  This  permits 
rewriting  (1)  in  the  form: 

Hlotzkin,  T.  S.,  1936,  Doctoral  Thesis,  University  of  Basal,  Beitrage  zur 
theorie  der  Linearen  Ungleichungen. 

2 

Fourier,  J.  B.  J.,  "Solution  d’une  question  particuliere  du  calcul  des 
inegalites,"  1826  and  extracts  from  "HIstoire  de  ' lAcademie",  1823, 

1824,  Oeuvres  II,  pp.  317-328  (French  Academy  of  Sciences). 


I 


(2) 


p1'8 1 

<  1  E1  (x)  | 

j ' 

V  x:  >_  D  (x) 

•  \ 

•  h 

<  x  <  E  (x)  \ 

1  —  q 

0  1  F1(x) 


0  <  F  (x) 
—  r 


where  D  (x),  E.(x),  F,  (x)  are  linear  functions  of  x 
i  J  k 

It  may  be  solved  by  first  solving  the  reduced  system: 
satisfying 


=  (x2, 
Find 


•  •  • 

x 


X  ) 


(x)  Ej  (x)  i  —  (1|  •  •  •  )P)  !  j  =  k  —  (l»*««»r) 

(3) 

0  <_  FR(x) 

and  then  finding  an  x^,  satisfying 

(4)  Max  D  (x)  <_  x1  <_  Min  E.  (x)  , 

i  i  3 

where  x^  always  exists  providing  there  exists  an  x  satisfying  (3). 

Proof :  Given  any  (x^,  x)  satisfying  (2),  it  is  clear  that  (3)  and  (4) 

must  hold.  Conversely,  given  any  x  satisfying  (3),  then  Max  D^(x)  <_ Min  (x) 

and  we  can  always  fiitd  an  satisfying  (4);  hence  (x^,  x)  satisfies  (1). 

System  (3)  is  said  to  be  the  result  of  "eliminating"  x^  from 
system  (2).  If  p+q  <_  4,  the  reduced  system  contains  one  less  variable 
and  no  more  inequalities.  If  p  >  2,  q  >  2,  r  =  0,  however,  the  process  of 
elimination  will  greatly  increase  the  number  of  inequalities.  This  is 
the  chief  reason  given  why  it  is  not  used  as  a  practical  solution 
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fMW?awa)wwwn. 


method.  It  is  worth  noting,  however,  that  (3)  has  special  structure 
and  that  this  might  be  used  to  advantage  to  develop  it  into  a  practical 
computational  procedure. 

Since  (3)  is  a  linear  inequality  system  also,  one  could  next  proceed 

to  eliminate  x^  etc.  until  one  has  eliminated  all  but  a  single 

variable,  say  x^.  The  original  system  is  solveable  if  and  only  if 

the  final  system  x  <  a  ,  x  >  $  ,  0  <  y.  for  i  *  1,  ...  ,  p', 

n  —  l  n  —  j  —  k 

j  =  1,  ...  ,  q',  k  =  1,  ...  ,  r’  is  consistent,  i.e.,  iff  ^  0 

and  >_  0  for  all  i,j,k.  Another  way  to  state  this  is 


Feasibility  Theorem;  A  necessary  and  sufficient  condition  that  system 

(1)  is  solveable,  is  there  exist  no  set  of  weights  (y^  0,  y^  _>  0 . y^  _>  0) 

such  that 

m  m 

(5)  D  y.b  >0  and  £  y.a  *  0  for  j  *  (1 . n). 

i=l  i=l 


Proof  (Abadie):  Assume  a  solution  x  to  (1)  exists  and  there  exists 
weights  yt  >_  0  satisfying  (5),  then  (1)  implies 


(6) 


c 

J-l 


m 


<E 

i*l 


m 

yiaij,xi  -  & 


yibi 


Y±  1  0 


or  Ox  >_  ^  >  0,  a  contradiction.  Thus  the  condition  is  necessary. 

Assume  no  solution  x  to  (1)  exists,  then  note  each  system 
generated  by  the  elimination  process,  for  example  (3)  from  (2),  is  formed 
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by  non-negative  linear  combinations  of  the  inequalities  of  the  previous 

system  which  in  turn  were  formed  by  non-negative  linear  combinations 

of  the  system  one  before  that,  etc.,  back  to  the  original  system  (1).  Thus 

the  condition  for  non-solveability ,  a.-$.  <0  or  y,  <  0  for  some  i,j 

1  J  * 

or  k  (referred  to  earlier)  could  be  derived  directly  by  some  non-negative 
linear  combination  of  the  inequalities  of  the  original  system. 

This  remarkably  simple  proof  of  the  feasibility  theorem  based  on 
Fourier-Motzkin  elimination  is  due  to  Jean  Abadie.  From  it  one  can 
derive  easily  (by  trivial  algebraic  manipulations)  the  fundamental  Duality 
Theorem  of  linear  programming,  Farkas  Lemma,  the  various  theorems  of 
the  alternatives,  and  the  well  known 

Motzkin  Transposition  Theorem:  Given  the  dual  homogeneous  linear 

progrcim  in  partitioned  form 


(7) 

Primal : 

Vi  +  aiixji  '  0  • 

(xr  xn*  - 0 

Dual: 

y\  1  o.  yAu  i  o  , 

then  either  there  exists  a  solution  to  the  dual  such  that  yAj  <  0 
(i.e.,  holds  strictly  in  all  components)  or  there  exists  a  solution 
to  the  primal  such  that  x  /  0. 


J 

f 


Proof:  A  solution  to  the  dual  such  that  yAj  <  0  implies  there  exists 
a  y  such  that 


yAj  <_  -e 


e  -  (1  ,  1>  •••  ,  1) 


i  0  • 


If  no  such  y  exists  satisfying  (8),  then  by  the  feasibility  theorem, 
there  exists  weights  x  >_  0,  x^j  >_  0  such  that  A^x^.  +  =  0 

and  "exj  <  0*  i«e*»  xj  /  0* 


The  Dual  of  Fourier-Motzkin  Elimination.  Suppose  we  are  given  the 
homogeneous  linear  program 


/  -x,  +  E.x  >  0 

\  1  J  ~ 


i=  (1,  •••  ,  p) 


j  ~  (1,  •  •  •  ,  q) 


F,  x  >  0 
k  — 


k  =  (1,  •••  ,  r) 


where 


x  =  (x2 . xn)  and  Dt,  Ej ,  Fk  are  1  x  n.  The  elimination 


of  x^  from  (9)  yields 


(Ej-D^x  i  0 


F,  x  >  0 
k  — 


for  all  i,j 


for  all  k  . 


On  the  other  hand  the  homogeneous  dual  of  (9)  is:  To  find  u^  _>  0, 
Vj  >  0,  wk>0  such  that 
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£  »i  -  £  *j 

i=l  j=l  J 


-  £  ut  Di  +  S  vi  E,  +  E  w 

i=i  11  j=i  J  J  k=i 


k  \  =  0 


and  the  homogeneous  dual  of  (10)  is:  To  find  X  ^  0,  w,  _>  0  such 

ij  'c 


that: 


£  £ 


i-i  j-i 


VW  +  £  »V  Fv  -  » 


Since  (9)  and  its  eliminated  form  (10)  are  in  a  sense  equivalent 


systems,  it  seems  natural  to  expect  that  their  duals  (11)  and  (12), 


are  also  equivalent  in  the  same  sense;  i.e.,  from  any  solution  to  (11)  we 


can  derive  a  solution  to  (12)  and  conversely.  Note  that  (11)  has 


n  equations  corresponding  the  the  n  components  of  whereas  (12) 


has  n-1  equations  but  would  have  (in  general)  far  more  variables. 


This  suggests  we  have  at  hand  a  technique  for  reducing  the  number  of 


equations  in  a  linear  program.  Let  us  give  a  direct  proof  of  this  for 


the  non-homogeneous  system; 


Find  u,  >  0,  v.  >  9,  w  >  0  satisfying: 
i  -  J  -  k“ 


(a)  £  »t  -  t  v 

i=l  j=l  J 


“  £  Vi  +  £  v.E.  +  ^  vv 
i=l  i=l  -1  J  k=l 


Fk  =  g 
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■ 


l 


Let  us  introduce  pq  new  variables 


>  0 


by  setting 


(14) 


f  \ 

ui  "  s,  Au  • 

vj  “  t  Aij  • 

J  i-i 


i  =  (1»  •••  >  p) 


j  =  (1  >  •  •  •  > 


Note  that  if  u^  and  satisfy  (13) (a),  it  is  always  easy  to  find 

u  _>  0  satisfying  (14).  Even  if  u^  _>  0  and  v^  _>  0  are  constrained 
to  be  integers,  it  is  easy  to  find  integer  A  >_  0  satisfying  (14). 
Substituting  (14)  into  (13)  we  note  that  (13) (a)  is  automatically 
satisfied  and  we  obtain  the  reduced  system: 

Find  A,,  >  0,  w,  >0  such  that 
11  —  k  — 


(15) 


£  £  »!,<*.-»!>  +  e  »k  v 

i-l  j-1  j  J  k-1 


Conversely  note  that  if  we  have  a  solution  to  (15),  we  can  by  regrouping 
the  terms  and  substituting  u^  and  v  for  the  resulting  expression 
Aij,  obtain  a  solution  to  (13).  The  solution  will  be  in  integers  if 
A^j  is  integral. 

To  apply  the  technique  to  a  system  of  equations  in  non-negative 
variables,  it  is  necessary  to  have  one  equation  with  a  zero  constant 
term  to  play  the  role  of  (13)  (a)  or  to  create  an  equation  with  a  zero 
constant  term  by  replacing  one  of  the  equations  by  some  appropriate 
linear  combination  of  the  equations  of  the  system.  This  will  yield  an 
equation  of  the  form 
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(16)  £  a.  U  -  b  v  =  0  a  >_  °,  6  >  0  , 

1=1  1  j=l  J  J  3 

and  we  could  obtain  a  system  of  form  (13)  by  a  change  of  units.  This 
may  conveniently  be  done  by  replacing  (14!,  by 


(17) 


ai  ui 


Vj 


1  =  (1»  •••  *p)  » 


j  =  (1,  ...  ,  q)  , 


where  >  0,  >  0,  A 


°»  ui  i  vj  >  0. 


Application  of  the  Dual  of  the  Motzkin  Elimination  to  Integer 
Programs :  As  long  as  =  1,  =  1  for  all  i,j  we  have,  as 

pointed  out  earlier,  a  reduced  system  of  equations  (16)  in  integer 
variables  A^  ^  0  if  u^,  and  v^  are  integers.  In  general,  however, 
for  the  case  where  >  0  and  >  0  are  integers  different  from 
unity,  we  have  to  resort  to  more  complicated  substitutions.  This  will 
be  illustrated  below  for  a  simple  example.  Suppose  we  have 


(18)  (ux  +  2u2)  -  (V;L  +  v2  +  v3)  =  0 


Let  us  rewrite  this 


(19)  (u1  +  u2  +  u3)  -  (vx  +  v2  +  v3)  =  0  , 
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where  =  u^  and  set  as  above 


E  . 

j=l  1J 


j  -  (1,  2,  3) 


(20) 


E  » 

i=l 


i  =  (1,  2,  3) 


The  resulting  integer  reduced  system  is  in  A  ^  0  (as 
before) except  we  have  the  additional  condition  =  u^  which  in 
of  Ay,  becomes 


(21) 


(X21  +  X22  +  X23^  '  ^X31  +  A32  +  X33^  =  0 


But  (21)  is  in  exactly  the  form  we  need  for  the  integer  reduction. 
We  accordingly  can  introduce  additional  integer  variables  _>  C 


'“■jSr*!  • 


i  -  1,  2,  3 


(22) 


X3j  "  ±E  ^ij  ’ 


j  -  1.  2,  3 


terms 


,  where 


Back  substituting  into  (20),  we  have  the  desired  integer  substitution 
in  terms  of  12  auxilliary  variables. 


3  3  3 

U1  =  Xlj  *  U2(=  U3)  =  ,5,  uij  * 


J-l 


i-1  j-l 


(23) 


v  =  x  +  2  ^4  +  t  “u 
1  11  j-l  1=1 

3  3 

v2  "  A12  +  £  M9,  +  £  V 


J-l 


2j  '  jti  Hi2 


3  3 

v3  =  ^13  +  £  ^31  +  £  ^i3 

j-l  2  i-1 


By  setting  p12  +  U21  w12.  u13  +  U31  =  u13’  p32  +  u23  =  y23  We 

could  simplify  the  above  substitution  to  one  involving  nine  non¬ 
negative  integer  variables  A^,  u^»  where  i,j  =  1,  2,  3  and  i  /  j . 

The  problem  in  general  of  finding  substitutions  to  replace  (17) 
so  as  the  reduce  a  linear  system  in  non-negative  integer  variables  to 
fewer  equations  is  under  study  and  will  be  the  subject  of  a  subsequent 
paper. 
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